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(54) Process microscopy system 

(57) A confocal microscope system has a turntable 32 with object locations for mounting multiple samples 4 
to be examined in a ring. The turntable is rotated about an axis concentric with the ring. At least one confocal 
microscope optical system (30) is mounted with components movable axiaily and radially relative to the ring 
so that an object region may be scanned through samples mounted in the object locations, each microscope 
system including a point image detector (12) providing a signal output, and a demultiplexer 44 receiving the 
signal output and isolating signal segments associated with different sample locations. A multiple channel 
signal processor 46 process the signals associated with different locations, and a control unit 14 moves axiaily 
movable components of each optical system firstly to establish focus reference data for each object and then 
to control the focus of the microscope responsive to the focus reference data as it scans successive object 
locations. 
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At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal copy. 
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PROCESS MICROSCOPY SYSTEM 
This system relates to process microscopy, and more 
specifically to a confocal microscope system suitable for 
the microscopic examination of large numbers of objects, for 
example microscope slides, in applications such as automated 
histological analysis, morphometry, inspections of semi- 
conductor wafers and micromachined components, and other 
applications involving the inspection or analysis of animate 
or inanimate objects of very small dimensions. 



Scanning microscopes are well known in the 
microscopy art and confocal microscopes in particular are 
capable of providing enhanced resolution and the capability 
of three dimensional imaging of objects, utilizing the 
15 ability of such microscopes to reject image data other than 
that from the particular focal plane being scanned. 

A disadvantage of such microscopes is the 
considerable time generally needed to complete a scan of an 
object, which reduces the usefulness of the technology in 
20 process microscopy, where substantial numbers of objects 
require to be imaged. 



Attempts have been made to improve the speed of 
confocal microscopy by utilizing multiple aperture scanning 
disks, such as Nipkow disks, but such rotating scanning disks 
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20 



25 



30 



increase the complication of the basically simple confocal 

r^rr^ sy . stea - and are ±n ^i Ci&nt 

optically, which may again require a trade-off between 
resolution and speed. " 

5 The principles of confocal microscopy were disclosed 

xn U.S. Patent No. 3,013,467 (Minsky, , and are described in 
considerably more detail in the boo* -Confocal Microscopy- 
edxted by T. Wilson, Academic Press, 19 90 . 

The present invention seeks to provide substantial 
> improvements in the overall rate in which objects can be 
imaged or analyzed utilizing a scanning microscope, in 
process microscopy, without incurring penalties in the 
resolution and contrast ratio of the images obtained, and 
whilst providing efficient application of available 
computational power to the processing of data generated by 
the system. The system is applicable to the production of 
two^and three dimensional images of objects in the form of 
slides as well as i n vitro and in viv„ organisms. • 

According to the invention, a microscope system 
comprises a turntable having multiple locations for mounting 
multiple objects to be examined in a ring, means for rotating 
the turntable about an axis concentric with the ring, and 1* 
least one scanning microscope mounted for radial movement 
relative to the turntable such that its focal point scans the 
object locations as the turntable rotates, and means for 
separately collecting data related to objects in each object 
location. Further features of the invention will be apparent 
from the following description and the appended claims. 

with re^^ emb °* ilaents of invention are described 
with reference to the accompanying drawings, in which: 

Figures 1A and IB diagrammatically illustrate basic 
configurations of reflective and transmissive confocal 



microscope conf igurations ; 

Figure 2 diagrammatically illustrates fundamentals 
of the system of the invention; 

Figure 3 illustrates diagrammatically a preferred 
5 optical configuration; 

Figure 4 is a diagrammatic plan view illustrating 
further features of the invention; 

Figure 5 diagrammatically illustrates further 
features of the control computer and electronics; and 
10 Figure 6 is a diagrammatic isometric view of a small 

portion of a microscope slide, to which reference is made to 
illustrate certain aspects of the functioning of the 
invention. 

Figure 1A illustrates a taown conf oca 1 microscope 
15 configuration. A light source 2, typically a laser providing 
a continuous high intensity light source of a visible or 
invisible (ultraviolet or infrared) radiation, appropriate to 
the type of imaging or examination being carried out, 
provides a point source of light which is focused upon a 
20 point on an object 4 by means of an objective lens 6. Light 
reflected from the object is collected by the lens 6 and 
intercepted by a half-silvered mirror 8 which diverts it so 
that it is focused on a detector comprising a mask 10 
defining a pin hole in front of a photodetector 12 ♦ The 
25 output from the photodetector 12 is passed to a computing and 
display device 14, which also controls an X and Y scanning 
device 16 which moves the object 4 relative to in two 
dimensions relative to the focus of the lens 6. 

Figure IB illustrates how a basically similar 
30 arrangement may be utilized for the examination of an object 
4 by transmitted light. Here the half -silvered mirror 8 is 
omitted, and replaced by a further collector lens 18 between 
the object 4 and the photodetector 12. in this case, both 
the source 2 and the mask 10 are moved to provide scanning in 
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two dimensions. 



Referring now to Fioure 2 a i 

yu " e ^' a light: source 2 A is 

she™ to illustrate that the principles of the present 
xnvention may be empioyed in a system in which the microscope 
5 operates xn transmissive mode, hut all further descripti™ 
wxll assume that the microscope operates in reflective mode. 

The optical configuration utilised in a preferred 
embodiment is shown in Figure 3. The llght sour=e 2 
associated with a colligating lens 20 which projects a 
10 parallel beam through the half-silvered mirror 8 onto the 
lens 6. which in turn focuses the light at a point in or on 
the surface of a slide 4 forming the object. The focus of 
the lens 6 is controlled by a focusing device 22, typically 

i 5 ioor zoel rT c cryst " ° r voiaa 0011 22 - d ~ <*« °* «*— 

15 loo? control of a driver 24 which in turn receives 
instructions from a computer and control system 14. The 
collector lens 18 focuses light reflected from the object and 
intercepted by the mirror 8 onto the aperture of the pin hole 

20 nhoL ' be f iM WhiCh tte P hot °**«*or 12 (which may be a 
20 photomult.pl.er if retired, generates an electrical signal 
proportxonal to the intensity of the incident light, wnlch 
sxgnal x, passed to a preamplifier 26 and thence via an 
analog to digital converter (see, 28 to the COBputer 

28 !Zr ientlr ' 0t 0ptl=al «~*.. including the 

mount r""' £OCUS CO " "* «» P^etector. are 

mounted in a common housing 30 (see Figures 2 and 4). 

Referring to Figures 2 and 4, the slide 4 or other 

20 Ii^" k" ^ ° f 8 substantIal "-««. *or example 72 
20 although it may be less or more, mounted in a ring on a 
turntable ,2 rotatable by a motor 34 at a constant ra£ about 
an axis parallel to the optical axis 38 of the lens 8. The 
housing 30 is mounted on an arm 38, driven for radial 
movement relative to the turntable 32 by a stepping motor 40 
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controlled by the computer 14. A scanning head 42, connected 
to the computer 14, scans the periphery of the turntable 32 
as it rotates, for data providing the computer with the exact 
rotational position of the turntable at any time, as 
5 described in more detail below. 

The motor 40 provides two rates of advance of the 
arm 38 and hence the microscope housing 30 radially across 
.the annular zone of the turntable in which the objects 4 are 
mounted. These modes, here in turn "coarse" and "fine" are 
10 . both related to rotation of the disk such that each rotation 
'causes the arm 33 to move incrementally aldng a radius of the 
turntable. The coarse increments are a multiple of the fine 
increments, so that, for example, if the fine increments are 
1 micron, the coarse increments may be 20 microns. It 
15 follows that, in this example, a succession of fine 
increments will mean that a traversal of the objects to be 
scanned will require twenty times as long as would be the 
case with a coarse scan. The coarse and fine scan are 
employed respectively during a normalization phase and an 
20 imaging phase of the operation of the device, as described 
further below. The mode of operation of the motor 40 and arm 
38, and the technology used, is essentially similar to that 
employed for moving the recording and/or playback heads of a 
magnetic or optical disk drive, although the requirements for 
25 precise absolute positioning of the head by the stepping 
mechanism may be less critical. 

In a preferred arrangement, positional data for 
pickup by the head 42 from the disk may be in the form of two 
regularly spaced tracks, one containing marks corresponding 
30 to the ones, and the other consisting of marks corresponding 
to the zeros, of a maximum length pseudo-random binary 
sequence, enabling the precise position of the disk at any 
time during its rotation to be determined by the control 
computer 14 through a calculation employing the generating 
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functxon of the particular maxima* length sequence inscribed 
on the disk, as described for example in "Binary Sequences- 
by c. Kof fBan de Visme, English Universities Press, or -shift 
Register Sequences- by J. Golomb, Van Nostrand. 

5 As the turntable 32 rotates, the reflectivity of 

successive large radius arcs of the objects are detected 
successive slides or other objects providing signal samples 
or pxxels at the output of the ADC 28 proportional to the 

10 ^inr"^" 51 ^ ° f reflected ^ a particular 

po^t. The signal from the detector is sampled at a rate 

proportional to the speed of rotation of the disk and 

suffxcient to provide the resolution required for the 

recognition of detail necessary for the process being 

performed, having reg ard for the processing speed of the 

15 computer i4 which receives the sampled pulses from the 

analog-to-digital converter 28. The information derived from 

21 T f ^ ^ ^ ^ 42 ±S * -i^hing 

unit 44 (see Fig. 5) associated with the computer 14 to 
switch data relating to each separate slide and assign it to 
its own coprocessing system 46 associated with the computer 
14 Each of the objects on the turntable has a separate 
coprocessing system assigned to it. Each coprocessing system 
will execute an identical program on the particular pixels 

25 7ilT*t ^ ^ fr °° ^ anal °9-to-digital converter 28, 
25 although it will operate independently, and differed 
subroutines and procedures may be executed by the different 
coprocessor systems in accordance with the data encountered 

" COUrS€ ° f ° Perati °»* »U* the coprocessing 

systems may be implemented by a multi-tasking system, or 
30 separate processors, it is preferred that the processing 
systems are parallel autonomous sections of a single 
coprocessor unit appropriately segmented for the task. Each 
of the autonomous sections in the preferred embodiment forms 

35 1!! , a DatriX ° f eleaentar y computers operating in 
35 sistolic mode, such that all computers in a particular row of 
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the matrix perform the same operation on different data so 
that a sequence of different operations (as in an assembly 
line) is performed on a given data item as it travels down a 
column. This mode of operation, termed "SIMD" or "Single 
5 Instruction (per row) Multiple Data (per row)" is known in 
the art. A suitable systolic coprocessor unit is described 
in our co-pending United States Patent Application No. 
944, 924. 



The tine interval between receipt by a given 
10 coprocessor system of an arc or pixels from a slide or other 
object, and the time when it receives a following arc of 
pixels from the same slide, is termed its duty cycle, which 
is equal to the rotational speed of the disk, which in an 
exemplary embodiment might be ISO rpm, corresponding to the 
15 duty cycle of 330 milliseconds. During this period, the data 
received by each coprocessor may be processed to compress it 
utilizing known data compression techniques such as run 
length and/or Huffman encoding, subjected to enhancing 
techniques if required, and assembled with data from other 
20 arcs from the same slide to build up a compressed image. The 
processing may be such as to facilitate the recognition of 
anomalies, abnormalities or other distinctive features of the 
object being examined. Although the time required to examine 
and analyze data from an individual slide or other object may 
25 be lengthy, possibly as long as an hour, the large number of 
slides being processed simultaneously means that the actual 
average rate of examination can be quite high. Thus if sixty 
slides are processed in an hour, the average rate of 
processing is one a minute. It will also be noted that the 
to arrangement just described entails only quite modest 
computational requirements for each of the coprocessor 
systems, even though the total quantity of data being 
processed may be very large. 
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It is a feature of confocal microscopy that not only 
is xt capable of excellent resolution in an image plane, but 
it also provides excellent rejection of data from points 
displaced on the Z axis relative to that plane. This has two 
5 consequences. Firstly, focusing is very critical, and 
secondly it is possible to image different planes of the same 
object to provide three dimensional imaging. The control of 
focus is an important aspect of the present invention. 

Each slide, or other object to be examined and 
10 located on the turntable, may have variations in thickness 
and profile due to manufacturing tolerances, as well as much 
larger variations found in biological slide preparations due 
to the manner in which samples are placed on a slide 
Furthermore, there may be manufacturing inaccuracies in the 
15 turntable, and in means provided to locate slides or other 
objects on the turntable. since the turntable may be of 
significant diameter in order to accommodate a large number 
of objects, and rotated at a substantial velocity, mounting 
means provided for the objects must be sufficiently robust to 
20 locate them securely under these conditions. Furthermore as 
is illustrated in Figure 6, cells C within a biological slide 
may be at different levels within a sample, and cells on one 
level may overlay cells located on another level, confocal 
microscopy enables precision focusing on any layer, with 
25 resolutions in the micron range, m process microscopy, and 
particularly in the system already described, cells to be 
examined will be located at different heights above the upper 
surface of the slide on each slide, while cells at different 
points along the length and width of the slide may also 
30 differ in their height above the top surface of the slides. 
The slides may also be displaced relative to the optical axis 
both because of manufacturing tolerances in the slides and in 
the turntable upon which the slides are mounted 
consequently, there will be continuous variations in the 
35 axial position of wanted data as the turntable rotates 
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requiring means for maintaining and controlling an 
appropriate focus of the lens 6. 

The coarse scanning mode is employed in an initial 
normalization phase in order to provide focus data which is 
5 stored in the computer 14 and utilized to control the 
focusing means 22 as the disk rotates. Such continuous 
control of focus is somewhat analogous to that enployed in 
reading optical disks, although, as will be noted, the 
derivation of the data utilized to control focusing 
lo substantially different. 



2.S 



15 



20 



A focus may be initially established by a manual or 
automatic procedure utilizing the top surface 5 (see Figure 
6) of a slide or other object as a reference. To facilitate 
the procedures to be described, this top surface may be 
coated with a layer which has a high and known reflectivity 
at the wavelength of the light source 2. This known high 
reflectivity will result in an identifiable high level of the 
signal from the detector 12 when the lens 6 is focused on the 
slide surface. 



As the microscope housing 30 is subjected to coarse 
stepping across the lane of slides during a normalisation 
phase, an oscillatory waveform is applied to the focusing 
device such that it moves up and down through a distance of, 
for example, ±5 microns with respect to a reference level 
25 located, for example, one or two microns above the nominal 
surface level of each slide. The top surfaces of the slides 
will be areas of maximum reflectance, corresponding to a 
signal magnitude the value of which has already been stored 
in the control computer. The incoming signals are thus 
30 analyzed for the occurrence of this reflectance value, which 
can be noted whenever it occurs as a point at which the focus 
of the lens coincides with the surface of the slide. Using 
successive scans, the data gathered is used to vary the 
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position of the reference level progressively for the portion 
of the scan over each side as necessary to find the top 



surface of the slide. By collecting this data, a ffiap can 
thus be established of the various slide surfaces. The 
oscillation technique is sometimes known as -dithering- in 



the technical literature, and the procedure employed to 
obtain depth information is somewhat similar but not 
identical to the process or interactive reconstruction 
employing geometric probing, a topic discussed in literature 
10 relating to robotics, for example by S. Skiena in -Problems 
m Geometric Probing-, Algor ithmica , Vol. 4, pages 599-605 
19S9. other data can also be gathered during this period for 
later reference, such as the upper surface B a sample 
applied to the slide, and the distribution therein of 
15 features such as cells having identifiable reflectivity 
characteristics. All of this data can be utilized to control 
the following imaging phase. 

Once the positions of the slide surfaces, or some 
alternative reference surface appropriate to the objects 
20 being examined, have been established, the imaging phase 
utilizing the fine stepping is commenced. The focus of the 
lens 6 is controlled according to the stored data so as to 
maintain the focus of the lens 6 at the reference level, if 
a three dimensional image is required, multiple scans may be 
utilized at displacements from the reference level which may 
be selected on the basis of other data collected during the 
normalization phase so as to image features of interest. 

In carrying out the coarse scan, the permissible 
coarseness win depend upon the application. For example, in 
10 biological slides, variations in thickness are typically 
negligible over lateral distances between 30 and 60 microns 
whilst m most instances of practical interest in pathologC 
and histology, cells found in such slides have a flattened 
thickness of between 3 and 8 microns. The relevant data 
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relating to each slide as determined during the coarse scan 
is stored in the processor system associated with that slide, 
and is utilized to control the focusing, i.e. the position on 
the z axis of the lens 6, as it passes over that slide during 
5 successive scans. 



The data stored by each processor system in relation 
to its associated slide may thereafter be utilized to 
construct two or three dimensional images on an imaging 
system 48 for subsequent human assessment, or may be 
10 processed utilizing pattern recognition or other algorithms 
to recognize normal or abnormal features of each object, for 
example abnormal cells in a biological sample. 

Whilst the embodiment described utilizes a single 
microscope in the microscope housing 30, it may be 

15 advantageous to provide 2, 3 or more similar microscopes 
distributed around the periphery of the turntable, in order 
to improve the scanning rate of the apparatus. Incorporation 
of such multiple microscopes in the system should not 
influence the resolution and performance obtained, and whilst 

20 they will influence the duty cycle by reducing tbe time 
available for each processor system to process the data 
associated with a scan of its associated slide, the time 
available should remain ample with any reasonable number of 
microscopes. Accordingly, the speed of the apparatus may be 

25 increased within reason simply by multiplying the number of 
microscopes utilized. 
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CLAIMS: 



10 



1. A confocal microscope system comprising a turntable 

having locations for mounting multiple objects to be examined 
ma rang thereon, means for rotating the turntable about an 
3X15 Conc * ntric ^e ring, a microscope optical system 

mounted for radial movement relative to the turntable such 
that a focus of an objective thereof may be scanned over 
objects mounted in said locations, the microscope optical 
system including a point image detector providing a signal 
output, and signal processing means receiving said at least 
one signal output and separately processing those portions 
of said signal output associated with each object. 



IS 



20 



2. A system according to claim 1, wherein the means for 

radially moving the microscope is correlated to rotation of 
the turntable to move the microscope incrementally for each 
rotation of the turntable. 

3- A system according to claim 1 or 2, including a 

coprocessor system for signals associated with each object. 

4. A system according to claim 3, where the coprocessor 

systems are portions of a matrix of systolic processors. 

5* A system according to claim 4, wherein the focusing 

means is a voice coil or a piezoelectric element. 

6. A system according to any of the preceding claims, 

2S llZT ^ niCr ° SCOpe is * confo ~l horoscope, including an 
2S objective lens, and includes a focusing device for moving the 

focus of such lens in an axial direction relative to the 

turntable. 

7- A system according to any of the preceding claims, 

wherein the turntable carries a ring of encoded markings 
30 including a pickup device for sensing said marking and 
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connected to the signal processing device so that the latter 
nay identify portions of the signal output associated with 
different objects. 



3. A system according to claia 7, including a control 

5 computer for controlling said means for radially moving the 
microscope and operating said focusing means in two phases, 
a normalization phase in which the focusing means are 
controlled during scanning to vary the focus of the objective 
lens, and the data accumulated is analyzed to determine the 

10 axial position of a recognizable reference plane associated 
with each object so as to gather data mapping said plane for 
each object, and an imaging phase in which said focusing 
means is controlled to maintain the focus of said objective 
lens in a predetermined relationship to the plane mapped 

15 during the normalization phase. 

9 ' A system according to claim 8, including means to 

repeat scans during the imaging phase a plurality of times 
whilst progressively altering the relation of the focus of 
the lens to the reference plane, to provide three dimensional 
20 data. 

10. a system according to any of the preceding claims, 
including a plurality of microscopes distributed around , the 
periphery of the turntable. 

11. A confocal microscope system comprising a turntable 
25 having object locations for mounting in a ring multiple 

objects to be examined, means for rotating the turntable 
about an axis concentric with the ring, and at least one 
confocal microscope optical system having components mounted 
for movement in respectively radial and axial direction 
30 relative to the turntable such that an object region may be 
scanned through samples mounted in said sample locations, 
each confocal microscope system including a point image 
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detector providing a signal output, a demultiplexer receiving 
said signal output and isolating signals associated with 
different sample locations, and signal processing means 
providing multiple channels for processing said signals 
associated with different sample locations, means for 
radially mounting said radially movable components to scan 
said sample locations, and means for controlling said axially 
movable components to focus said microscope firstly to 
establish focus reference data for each object and secondly 
to control the focus of said microscope responsive to said 
focus reference data. 

12. A method of process microscopy, comprising mounting 

a plurality of objects to be examined or analyzed on a 
turntable, rotating the turntable relative to a confocal 
microscope whilst moving the latter radially relative to the 
turntable, whereby to provide scanning of said objects in two 
dimensions, segmenting data output from said microscope and 
segregating data associated with each object, and separately 
processing said segregated data for each object. 

20 13. A method according to claim 12, including 

controlling the focus of said microscope during rotation of 
said turntable. 

14. A method according to claim 13, wherein said focus 

is controlled during two successive scanning phases, 

25 including a first phase in which the microscope is moved 
radially in relatively coarse increments, and the focus of 
the microscope is varied systematically during scanning, data 
from the microscope relating to each object is analyzed to 
establish the focus locations where the signal indicates 

30 coincidence of focus with a layer providing a recognizable 
signal or response, and a second phase in which the focus of 
the objective lens is controlled so as to maintain a 
predetermined relationship to the position of the layer as 
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mapped during the first phase. 

15. A method according to claim 14, wherein the second 
phase is repeated for different relationships between the 
focus of the objective lens and the position of said layer, 

5 whereby to develop three dimensional image data. 

16. A method according to any of claims 12 to 15, 
including continuously monitoring the angular position of the 
turntable to identify an object currently being scanned, and 
directing data from different objects parallel data 

10 processing means associated with each object. 

17 • A process microscopy system substantially as 

hereinbefore described with reference to the accompanying 
drawings. 

18 • A process microscopy method substantially as 

L5 hereinbefore described with reference to the accompanying 
drawings . 
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Abstract of GB2273994 

A confocal microscope system has a turntable 32 
with object locations for mounting multiple 
samples 4 to be examined in a ring. The turntable 
is rotated about an axis concentric with the ring. 
At least one confocal microscope optical system 
(30) is mounted with components movable axially 
and radially relative to the ring so that an object 
region may be scanned through samples 
mounted in the object locations, each microscope 
system including a point image detector (12) 
providing a signal output, and a demultiplexer 44 
receiving the signal output and isolating signal 
segments associated with different sample 
locations. A multiple channel signal processor 46 
process the signals associated with different 
locations, and a control unit 14 moves axially 
movable components of each optical system 
firstly to establish focus reference data for each 
object and then to control the focus of the 
microscope responsive to the focus reference 
data as it scans successive object locations. 
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